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IMAGE PROCESSING DEVICE 

Background of the Invention 

Field of the Invention 

This invention relates to an image processing device for 
correcting gradation data of color input image data that has 
been obtained by reading a document image with use of a copier, 
facsimile machine, scanner or the like. 
Description of the Related Art 

There sometimes rises a problem that image data obtained 
by reading a document image by a copier or the like may contain 
unnecessary image data that is undesired to be reproduced such 
as undertone and backside image. Particularly, in the case of 
reading a document image formed on color paper or a document 
image formed on both sides of extremely thin paper, data 
concerning the undertone or the backside image may likely to 
be included in the read image data. 

Unnecessary image data such as undertone data generally 
consists of lower gradation components. Monochromatic copiers 
that have been used heretofore enable to remove such an 
unnecessary image data by setting a certain gradation as an 
uppermost gradation of the unnecessary image data (e.g., 
undertone data) and cutting off gradation components lower than 
the uppermost gradation. 

As far as monochromatic image reading is concerned, it 
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is possible to reproduce an image with a continuous gradation 
by taking the following measures ♦ Specifically, as a further 
step of the above image processing, after removing the lower 
gradation components, the gradation range of the remaining part 
of the input image data including medium and higher gradation 
components is redefined as a new effective gradation range (for 
example, ranging from 0 to 255 gradations) , thus producing new 
lower gradation components . This arrangement makes it possible 
to prevent forming a conspicuous gradation difference (step) 
around a boundary region between the unnecessary image data to 
be removed and the remaining part of the input image data. 

In the case of color copiers that have been recently 
popular in the market, however, the above measures is not 
effective for the following reason when image processing is 
attempted to remove unnecessary image data such as undertone 
data from a scanned original color image data. 

A color image is composed by mixing a plurality of different 
color components such as red (R), green (G), and blue (B) or 
cyan (C) , magenta (M) , and yellow (Y) . Although mixing all the 
color components may produce a color different from undertone, 
there sometimes is a case that a certain image region of an original 
color image coincidentally contains a color component identical 
to a color component of the undertone. 

Let ' s say that the certain image region contains a specific 
color component (for instance, yellow color component) which 
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is identical to the undertone generally in a lower gradation 
range. For example, there is a case that an original document 
is tanned and accordingly the undertone thereof contains a yellow 
color component, and the original document image contains 
gradation data of a yellow color component of skin color of a 
human, which is coincidentally the same as the yellow color 
component of the undertone. 

In such a case , removing all the lower gradation components 
corresponding to the undertone may altogether remove the lower 
gradation components that are not originated from the undertone 
data. Consequently, a reproduced color image does not contain 
the lower gradation components that have constituted part of 
the original color image any more, and accordingly, the 
reproduced color image may look different from the original color 
image, thus degrading color image reproducibility. 

Further, since the gradation of the undertone generally 
differs color component by component , the uppermost gradation 
thereof to be cut off differs from color component to component. 
Accordingly, in image processing of a color image composed of 
different color components, it is considered to implement a 
gradation redefining process with respect to each of the color 
components in which the remaining gradation range ( uncut portion ) 
for each color component is magnified to fit to the available 
gradation range at a different gradation magnification rate with 
an attempt to suppress a gradation difference in the boundary 



P700US 



region. However, this gradation redefining process may cause 
an unbalanced distribution of color components , thereby 
resulting in poor color image reproduction. 

Summary of the Invention 

In view of the above problems residing in the prior art, 
it is an object of the present invention to provide an image 
processing device that enables to remove an unnecessary image 
data from color input image data while suppressing degraded color 
image reproduction. 

To accomplish the above object , the image processing device 
according to this invention judges that a pixel satisfying a 
certain unwanted gradation condition (or referred also as a 
certain removing gradation condition) with respect to all the 
color components is a unwanted pixel attributed to the 
unnecessary image data and hence to be removed, and each of the 
gradation data of the plurality of color components composing 
the unwanted pixel is converted into a certain background 
gradation which is predetermined with respect to each of the 
color components . 

In the above arrangement, there is no possibility that 
the pixel that has satisfied the unwanted gradation condition 
with respect to part of the color components is judged as the 
pixel to be removed. This arrangement enables to securely 
extract and remove the unwanted pixel attributed to the 
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unnecessary image data such as undertone and backside image data 
without unwanted part of the color components constituting the 
necessary image data, and enables to prevent poor color image 
reproduction accompanied by undesirable color change. 

These and other objects, features and advantages of the 
present invention will become more apparent upon a reading of 
the following detailed description and accompanying drawings. 

Brief Description of the Drawings 

FIG. 1 is a schematic diagram showing an entire 
construction of a color copying machine incorporating an image 
processing device embodying the present invention. 

FIG. 2 is a diagram showing a general arrangement of the 
image processing device. 

FIG. 3 is a diagram showing a detailed arrangement of an 
unnecessary image data removing unit and a gradation adjusting 
unit which are incorporated in the image processing device. 



FIGS. 4A to 4p are examples of histograms showing gradation 
distributions of input image data of cyan, magenta, and yellow, 
respectively . 

FIGS. 5A to 5C are examples of histograms after 
implementing a smoothing process with respect to the histograms 
of FIGS. 4A to 4C, respectively. 

FIGS. 6A to 6C are examples of histograms after 
implementing an unnecessary image data removing process with 
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respect to the histograms of FIGS. 5A to 5C, respectively. 

FIGS. 7A to 7C are examples of histograms after 
implementing a gradation adjustment to an adjusting image area 
with respect to the histograms of FIGS. 6A to 6C, respectively. 

FIG . 8 is an explanatory diagram illustrating a color image 
data composed of a plurality of pixel data. 

FIG. 9A is a diagram illustrating an example of a histogram 
before implementing the smoothing process. 

FIG. 9B is a diagram illustrating an example of a histogram 
after implementing the smoothing process. 

FIG. 10 is an explanatory diagram indicative of how to 
search for a target gradation. 

FIG. 11 is an altered explanatory diagram indicative of 
how to search for a target gradation. 

FIG . 1 2 is a further altered explanatory diagram indicative 
of how to search for a target gradation. 

FIG. 13 is an explanatory diagram schematically showing 
a spatial area which satisfies a requirement for removing an 
unnecessary image data and a spatial area which satisfies a 
requirement for adjusting a gradation of an adjusting image area 
respectively in a three-dimensional space in which three 
different color components of cyan, magenta, and yellow are 
represented by x- , y- , and z-axes, respectively. 

FIGS. 14A to 14C are diagrams schematically showing how 
a gradation difference appears and is eliminated. 




P700US 



FIG. 15 is a graph indicative of a gradation conversion 
curve for removing an unnecessary image data. 

FIG. 16 is a graph indicative of a gradation conversion 
curve for gradation adjustment of an adjusting image area. 

FIG. 17 is an explanatory diagram of image processing in 
the case where backside image remove mode is set. 

FIG. 18 is a graph indicative of an example of a gradation 
conversion curve which is a quadratic curve used in gradation 
adjustment of an adjusting image area. 

FIG. 19 is a graph indicative of an example of a gradation 
conversion curve in the case where a gradation conversion range 
is defined by setting an output limit by an image forming section 
of the color copying machine as a lowest gradation for gradation 
adjustment of the adjusting image area. 

Detailed Description of the Preferred Embodiments 

A color copying machine incorporating an image processing 
device embodying the present invention is described with 
reference to the accompanying drawings . 

FIG. 1 is a schematic diagram of a color copying machine 
incorporating the image processing device. The color copying 
machine 10 comprises an image reading section 20 for reading 
an original image of a color document P placed on a contact glass , 
an image processing section (image processing device) 30 for 
implementing a specified image processing to the color document 
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image read by the image reading section 20 as input image data, 
and an image forming section 40 for forming an image on recording 
paper based on the image data processed by the image processing 
section 30. 

The image reading section 20 is generally constructed as 
follows. Light from an exposure lamp 22 is irradiated onto the 
surface of the document P placed on a contact glass 21. The 
light reflected from the document surface is received by a 
photoelectric conversion element 2 5 such as a CCD by way of 
reflective mirrors 23a , 23b, and 23c, and color separation 
filters of red (R) , green (G) , and blue (B) to separate the color 
image data of the document P into three color components of red 
(R) , green (G) , and blue (B) so as to read color image data of 
R, G, B in proportion to light intensities of the respective 
color components. The read color image data of R, G, B are 
respectively analog-to-digital converted into digital values 
to be inputted to the image processing section 30 as input image 
data. 

The image processing section 30 comprises a computer 
circuitry including a computation section, a memory, and the 
like, which are not shown in FIG. 1. The input image data read 
by the image reading section 20 is subjected to a certain image 
processing to produce corrected input image data depending on 
a developing characteristic of the image forming section 40. 
The arrangement and image processing procedures of the image 
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processing section 30 are described later. 

The image forming section 40 is generally constructed as 
follows. An image transfer unit 42 is adapted to transfer a 
toner image on recording paper fed from one of sheet cassettes 
411, 412, 413 all of which are disposed in a lower part of the 
copying machine/ or from a manual tray 414 based on output image 
data. The recording paper is discharged onto a discharge tray 
44 after having the toner image fixed by a heater roller 431 
and a presser roller 432. Numeral 45 is a sheet inverting unit 
for turning the recording paper for double- sided image formation 
to transport the recording paper after one-sided image formation 
to the image transfer unit 42 again. 

The image transfer unit 42 has a photo-conductive 
photosensitive drum 421 rotatably supported about its own axis. 
The image transfer unit 42 further comprises a charger 422, an 
exposure unit 423, a developing unit 424, a transfer device 425, 
and a cleaner 426 around the photosensitive drum 421 from upstream 
in this order with respect to the rotating direction thereof. 
The charger 422 supplies a certain potential to the surface of 
the photosensitive drum 421 by corona discharge from a charging 
wire (not shown) when a high voltage is applied thereto. The 
exposure unit 423 selectively attenuates the surface potential 
of the photosensitive drum 421 by irradiating a laser beam of 
a certain light intensity from a laser emitter 423a by way of 
a mirror 423b in correspondence with output image data to form 
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an electrostatic latent image onto the surface of the 
photosensitive drum 421. The developing unit 424 develops the 
latent image into a toner image by supply of toner particles . 
The transfer device 425 transfers the toner image formed on the 
photosensitive drum surface onto recording paper. The cleaner 
426 removes residue charges and residue toner particles from 
the surface of the photosensitive drum 421. 

In the color coping machine 10 for forming a color copy 
image, the exposure unit 423 is adapted to form a latent image 
with respect to each of the color components of output image 
data, and the developing unit 424 further comprises four color 
developers 424c, 424m, 424y, and 424k respectively adapted for 
developing toner images of cyan (C), magenta (M) , yellow (Y) , 
and black (K) . The transfer device 425 temporarily transfers 
toner images of the respective colors which have been developed 
on the photosensitive drum surface onto a transfer belt 425a 
(first-step transfer), and then transfers the temporarily 
transferred toner images onto recording paper that is being 
conveyed over the transfer belt 425a in a superposing manner 
(second-step transfer) . 

Next, the overall construction of the image processing 
section 30 is described with reference to FIG. 2. 

The image processing section 30 in this embodiment 
comprises, in addition to an image processing controller 301 
and an operation panel 302 , a shading correcting unit 31 , a density 
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conversion unit 32, an unnecessary image data removing unit 33 
(hereinafter, simply referred to as data removing unit 33), a 
gradation adjusting unit 34 for adjusting gradation of an 
adjusting image area which is described later, a black data 
generating unit 35, an output color selecting unit 36, a 
magnifying unit 37, a spatial filter unit 38, and an output 
gradation correcting unit 39. 

The image processing controller 301 controls an overall 
operation of the copying machine 10 including the image 
processing section 30, the image reading section 20, and the 
image forming section 40 (image output section) . The operation 
panel 302 is adapted to receive an operation signal from a user. 
The operation panel 302 is provided with various keys including 
a start key and a copy number designation key, and is adapted 
to receive various operation signals including a signal 
indicating mode selection which is operable in the process of 
unnecessary image data removal . The mode selection is described 
later in detail. 

The shading correcting unit 31 compensates for exposure 
distribution characteristic of the exposure lamp 22 and light 
sensitivity distribution characteristic of the photoelectric 
conversion element 2 5 in the image reading section 20 with respect 
to input image data of R, G, and B that have been read by the 
image reading section 20. 

The density conversion unit 32 converts input image data 
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which are signals corresponding to light intensities of R, G, 

B, into signals (density recording signals) corresponding to 

C, M, Y, respectively. 

The data removing unit 33 and the gradation adjusting unit 
34 are adapted to implement a certain image processing which 
is the primary feature of this invention. These units 33 and 
34 are described in detail in the following section with reference 
to FIG. 3 and the other drawings when need arises to do so. 

The black data generating unit 35 generates image data 
of black color K by using image data of C, M, Y. 

The color correcting unit 36 converts color image data 
of C, M, Y, K into respective color data of C, M' , Y', K' in 
order to offset a difference between theoretical colors of 
respective color toners provided in the image forming section 
40 and what is expected to be reproduced on recording paper, 
taking into account the developing characteristic of the image 
forming section 40. 

The output color selecting unit 37 selects a next color 
to be developed in view of the fact that the image forming section 
40 executes development color by color. 

The magnifying unit 38 enlarges or reduces the image to 
be processed in accordance with a designatedmagnif ication ratio . 

The spatial filter unit 39 executes an outline highlighting 
process when the image data to be processed is a character or 
a text data, and executes a smoothing process when the image 
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data to be processed is a photographic image data or a half-tone 
image data. 

Next , the data removing unit 33 and the gradation adjusting 
unit 34 which are the primary elements of this invention are 
described. 

The data removing unit 33 removes unnecessary image data 
such as an undertone and a backside image which may be included 
in the input image data to be processed. As shown in FIG. 3, 
the data removing unit 33 is roughly divided into the following 
three elements: 

(A-l) a unwanted gradation condition setter means 331 for 
determining a gradation range of the unnecessary image data in 
the input image data to set a unwanted gradation condition 
(requirement) which is adapted to extract a pixel attributed 
to the unnecessary image data; 

(A- 2) a unwanted pixel judging means 332 for judging 
whether a pixel composing the input image data is the unwanted 
pixel which satisfies the aforementioned unwanted gradation 
condition; and 

(A-3) a unwanted pixel gradation conversion means 333 for 
converting the gradation of the unwanted pixel in order to remove 
the unwanted pixel. 

The gradation adjusting unit 34 implements the following 
process. Specifically, accompanied by dropping out a certain 
gradation range attributed to the unnecessary image data, it 
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is highly likely that a gradation difference (step) occurs in 
a boundary region between the removed image data and the remaining 
part of the input image data, thereby resulting in degraded image 
reproduction such as generation of a pseudo outline and a partial 
non-image formed area. The gradation adjusting unit 34 is 
adapted to prevent such a degraded image reproduction. 

The gradation adjusting unit 34 sets a pixel having a 
gradation closer to the gradation range of the unnecessary image 
data as an adjusting pixel and implements a certain gradation 
conversion to the adjusting pixel so as to suppress the 
above-mentioned gradation difference. 

More specifically, the gradation adjusting unit 34 is 
roughly divided into the following three elements : 

(B-l) an adjusting gradation condition setter means 341 
for setting an adjusting gradation condition ( requirement ) which 
is adapted to extract a pixel attributed to the adjusting image 
area; 

(B-2) an adjusting pixel judging means 342 for judging 
whether the pixel that has not been judged as the unwanted pixel 
is the adjusting pixel which satisfies the aforementioned 
adjusting gradation condition; and 

(B-3) an adjusting pixel gradation conversion means 343 
for converting the gradation of the adjusting pixel. 

Hereinafter, what is implemented by these elements is 
described one by one. 
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(A-l) unwanted gradation condition setter means 

The unwanted gradation condition setter means 331 is 
further divided into the following four sub-elements: 

(A-l-1) a histogram generating means 331a; 

(A-l-2) a smoothing processing means 331b; 

(A-l-3) a specific gradation searching means 331c; and 

(A- 1-4) a unwanted gradation condition determining means 

331d. 

(A-l-1) histogram generating means 

The histogram generating means 331a generates three 
histograms in each of which the number of pixels having a certain 
gradation value is indicated in terms of frequency with respect 
to cyan, magenta, and yellow, respectively, based on gradation 
data of input image that has been stored in a memory or obtained 
by pre-scanning. The thus produced histogram is used to set 
an appropriate unwanted gradation condition based on the input 
image data in accordance with the below-mentioned processes. 
Since the unwanted gradation condition for removing an 
unnecessary image data in the input image data is set based on 
each of the gradation data of the plurality of color components 
of the input image data, an accurate unwanted gradation condition 
can be set. 
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FIG. 8 schematically shows an example of a certain input 
image data. Each of pixels 90 has gradation values with respect 
to C, M, Y. The histogram generating means 331a, for instance, 
generates a histogram of cyan (C) by counting up the number of 
pixels with respect to each of the gradation values of cyan (C) 
throughout all the pixels 90, then, generates a histogram of 
magenta (M) by counting up the number of pixels with respect 
to each of the gradation values of magenta (M) throughout all 
the pixels 90, and finally generates a histogram of yellow (Y) 
by counting up the number of pixels with respect to each of the 
gradation values of yellow (Y) throughout all the pixels 90. 

FIGS. 4A, 4B, and 4C are examples of three histograms 
generated by the histogram generating means 331a based on a 
certain input image data. 

For sake of easy explanation, the histograms show 
illustrative specific curves. Since the histogram generating 
means 331a is provided in a computer circuitry, the frequency 
of each gradation value may be represented in terms of electronic 
data with respect to each color component . 

Generally, the unnecessary image data such as undertone 
and backside image data included in the input image data exhibits 
a characteristic such that a large peak appears in a lower 
gradation range in the respective histograms of cyan, magenta, 
and yellow. Accordingly, detecting an uppermost gradation 
value or a lowermost gradation value of such a characteristic 
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portion ( for example , a peak having the highest peak point ) which 
is presumed to be derived from the unnecessary image data enables 
to determine a gradation range of the unnecessary image data 
with respect to each of the color components. 

However , in light of the fact that a frequency of a gradation 
in an area lower than the gradation range of the unnecessary 
image data is generally small , a noise component may likely to 
be intruded in this lower gradation area, thereby undesirably 
generating a small range fluctuation (an up and down within a 
small gradation range indicated by the arrow in FIG. 9A) in the 
curve of the histogram. The occurrence of such a fluctuation 
obstructs accurate detection of the gradation range of the 
unnecessary image data. 

(A- 1-2) smoothing processing means 

The smoothing processing means 331b executes a smoothing 
process to eliminate the above-mentioned small fluctuation with 
respect to the histograms of the color components of C, M, Y 
in order to eliminate the noise component . The smoothing process 
is effected by implementing a computation by an average value 
filter represented by the following equation (1): 



where i is a natural number and a gradation value being changed 



h' (i)={h(i-l)+h(i)+h(i+l) }/3 



(1) 
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stepwise, h(i) is a frequency of the gradation value i, andh'(i) 
is a frequency after smoothing. 

The smoothing process in accordance with equation (1) is 
preferably repeated for a certain number of times (for example, 
three times) to securely eliminate the fluctuation that should 
not be detected* 

FIGS . 9A and 9B are diagrams describing smoothing process . 
FIG. 9A is an example of a histogram before smoothing process, 
and FIG. 9B is an example of a histogram after smoothing process . 
As shown in FIG. 9A # since the histogram produced from the input 
image includes a number of small fluctuations before implementing 
smoothing process, it is likely that accurate detection of a 
peak that is presumed to be derived from unnecessary image data 
maybe obstructed. However, implementing the smoothing process , 
as shown in FIG. 9B, in which smaller fluctuations are trimmed 
off while retaining the largest peak presumably derived from 
the unnecessary image data enables to more accurately detect 
the gradation range of the unnecessary image data. 

FIGS. 5A, 5B, 5C are examples of respective histograms 
corresponding to the histograms of FIGS. 4A, 4B, 4C after the 
smoothing process, i.e. , after implementing the computation in 
accordance with equation (1) for three times. 
(A- 1-3) specific gradation searching means 

The specific gradation searching means 331c searches for 
a specific gradation with respect to each of the color components 
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of C, M, Y based on the histograms. The specific gradation to 
be searched includes an uppermost gradation and a lowermost 
gradation of the unnecessary image data. FIGS. 10, 11 and 12 
are explanatory diagrams indicative of how to search for the 
specific gradation . 

As shown in these drawings, first, the frequency of each 
gradation is checked from the lowest gradation XS (gradation 
value of 0) toward a higher gradation to detect a lowermost 
gradation having a frequency greater than a predetermined 
frequency F0 so as to set the lowermost gradation as a detection 
start gradation X0 (see FIG. 10) . Setting a smallest frequency 
that is presumably judged to belong to the peak as the 
predetermined frequency F0 enables to define the detection start 
gradation X0 as the lowermost gradation of the gradation range 
of the unnecessary image data. 

Searching for the gradation from the detection start 
gradation X0 prevents a possibility that a noise component in 
a lower gradation area L0 lower than the gradation ranges LI, 
L2 which are supposed to be of the unnecessary image data be 
erroneously detected. Thus, the gradation ranges LI, L2 of the 
unnecessary image data can be securely detected. 

As shown in FIG. 11, in the case where the gradation range 
LI of the unnecessary image data includes the lowest gradation 
(gradation value of 0) , the lowest gradation XS (gradation value 
of 0) is set as the detection start gradation X0. 
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Thus determining the detection start gradation XO enables 
to carry on searching toward a higher gradation stepwise so as 
to detect a target gradation that satisfies one of the following 
four requirements or conditions (I) to (IV) as a specific 
gradation XI, X2, ... and so on: 

(I) under this condition, gradation at which the slope 
of the curve in the histogram shifts from negative to positive 
is the specific gradation; 

(II) under this condition, gradation at which a change 
rate of the slope of the curve in the histogram shifts f romnegative 
to positive is the specific gradation; 

(III) under this condition, gradation at which the slope 
of the curve in the histogram is negative, and a ratio of the 
frequency of the gradation to a sum of the frequencies of the 
gradations lower than the gradation including the gradation is 
or smaller than a predetermined value is the specific gradation; 

(IV) under this condition, gradation at which a distance 
(width) from the detection start gradation toward a higher 
gradation is or greater than a predetermined value is the specif ic 
gradation. This condition is applied exclusively to a first 
detected gradation. 

Condition ( I ) is adapted to detect a valley between two 
large peaks in the histogram . Generally , unnecessary image data , 
namely, data concerning undertone and backside image form large 
peaks respectively in the histogram. Accordingly, condition 
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(I) makes it possible to detect an uppermost gradation or a 
lowermost gradation of the gradation range of the unnecessary 
image data. Gradation XI in FIG. 10 is the specific gradation 
that has been detected by satisfying condition (I). 

Condition (II) is adapted to detect a specific portion 
of the curve where change of the frequency is great in the histogram. 
A certain area of a document may contain a plurality of kinds 
of unnecessary image data, for example, undertone and backside 
image in an overlapped state. In such a case, these different 
kinds of unnecessary image data are detected as different peaks 
in a proximate or superposing manner, thereby obstructing 
formation of a clear valley as detectable by condition ( I ) . Even 
in such a case, however, by taking the advantage of the fact 
that the curve of the histogram in the superposing portion changes 
in such a manner that the slope of the curve shifts from negative 
to positive or vice versa, condition (II) enables to detect the 
gradation that separates these two peaks. Gradations XI, X2 
in FIG. 11 are the respective specific gradations that have been 
detected by satisfying condition (II). 

Condition (III) is adapted to detect a 
higher-gradation-side terminal point of the peak in thehistogram. 
The peak supposed to be derived from the unnecessary image data 
in the histogram has a characteristic such that the frequency 
gradually lowers after passing the peak toward the higher 
gradation side with the result that there is a difficulty in 
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detecting a terminal point of the peak by conditions ( I ) or ( II ) . 
Note that, however, there is a characteristic that a ratio of 
the frequency of the gradation at the lower- side and higher- side 
terminal points of the gradation distribution of the unnecessary 
image data to the sum of the frequencies of the gradations of 
the unnecessary image data is significantly small. Taking into 
account this fact, a gradation at which a ratio of the frequency 
of the gradation to the sum of the frequencies of the gradations 
lower than the gradation and including the gradation is equal 
to or lower than a predetermined value can be judged as an uppermost 
gradation of the gradation distribution of the unnecessary image 
data. 

Namely, condition (III) is adapted to detect a gradation 
in which a ratio of the frequency of the checked gradation to 
the sum of the frequencies of the lower- gradation- side including 
the checked gradation is or smaller than a predetermined value, 
as a specific gradation representing the higher-gradation-side 
terminal point of the peak that is supposed to be derived from 
the unnecessary image data. Gradation X2 in FIG. 10 is the 
specific gradation that has been detected by satisfying condition 
(III)* 

Condition (IV) is adapted to prevent an erroneous detection 
in which an exceedingly high gradation is detected as a specific 
gradation in the case where none of the conditions (I), (II), 
(III) is applicable to detect the gradation for identifying the 
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unnecessary image data in the histogram. Condition (IV) is 
applicable only to a first detected gradation when searching 
for the target gradation from the detection start gradation XO 
toward higher gradation side by using the frequency of each 
gradation as a parameter. Condition (IV) enables to set the 
detection start gradation XO as a lowermost gradation of the 
unnecessary image data and automatically pick up a gradation 
higher than the detection start gradation XO by a certain 
gradation width L9 step by step by taking advantage of the fact 
that the gradation distribution of the unnecessary image data 
has a certain gradation range. Gradation XI in FIG. 12 is the 
specific gradation that has been detected by satisfying condition 
(IV) . 

In this way, by utilizing various conditions (I) to (IV) 
according to needs , the gradation range of the unnecessary image 
data can be securely searched to cope with a variety of kinds 
of input image data. 

Note that the specific gradation search by the specific 
gradation searching means 331c can be implemented stepwise from 
the lowest gradation (gradation value of 0) to the highest 
gradation (gradation value of 255 in the case where each of the 
color components has 256 gradations), or from the lowest 
gradation up to a predetermined gradation (for example, gradation 
value of 100 ) , or by picking up a certain number of ( for instance , 
two) specific gradations such as gradations XI, X2, ... which 
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are away from each other by a certain gradation width. In any 
case, terminating a specific gradation search upon detecting 
a predetermined required number of specific gradations XI , X2 , 
depending on the kind of removing process mode is preferable 
to shorten a search time . The removing process mode is described 
later. 

(A- 1-4) unwanted gradation condition determining means 

The unwanted gradation condition determining means 33 Id 
sets the gradation range of the unnecessary image data based 
on the specific gradations XI, X2, . . . which have been obtained 
by the specific gradation searching means 331c so as to determine 
a unwanted gradation condition based on the set gradation range 
of the unnecessary image data. 

As mentioned above, the unnecessary image data includes 
various data concerning undertone and backside image of a 
document, and what kind of unnecessary image data is included 
in the input image data differs from document to document . 
Accordingly, it is required to cope with any kind of unnecessary 
image data that is presumed to be included in the input image 
data when setting the gradation range of the unnecessary image 
data based on the specific gradations XI , X2 , .... For example, 
there is a possibility that necessary image data may be erased 
when attempting to remove backside image data from an input image 
data which does not in fact include data concerning a backside 
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image. There is another case that a backside image is 
intentionally desired to be copied. 

In order to cope with versatile demands of copying, the 
image processing device of this invention enables a user to select 
the kind of unnecessary image to be removed or erased according 
to his or her needs. Specifically, the image processing device 
provides two removing process modes , i.e., undertone remove mode 
to remove undertone data only, and undertone/backside image 
remove mode to remove undertone and backside image data. These 
two modes are selectively operable by the user . This arrangement 
makes it possible to selectively remove undertone or both 
undertone and backside image according to a user's demand. 

The image processing device may be provided with backside 
image remove mode to remove backs ide image data only while leaving 
undertone data. This mode is described as a modification of 
the embodiment in a later section. 

In the histogram indicating gradation distribution of an 
input image data including both undertone and backside image 
data, generally, a first peak appearing on the lower gradation 
side corresponds to undertone data, and a second peak which 
follows the first peak corresponds to backside image data. In 
FIGS. 10 and 11, the first detected gradation XI corresponds 
to an uppermost gradation of the undertone data, and the second 
detected gradation X2 corresponds to an uppermost gradation of 
the backside image data. 



25 




P700US 



Accordingly, in the case where undertone remove mode is 
selected in the image processing device of this invention, a 
range of gradation (ranges LO and LI) lower than the specific 
gradation XI which is the uppermost gradation of the undertone 
data is set as the gradation range of the unnecessary image data. 
In the case where undertone /backside image remove mode is 
selected, on the other hand, a range of gradation (ranges LO, 
LI, and L2) lower than the specific gradation X2 which is the 
uppermost gradation of the backside image data is set as the 
gradation range of the unnecessary image data. 

The unwanted gradation condition for determining a pixel 
to be removed from the input image data is set based on the thus 
obtained gradation range of the unnecessary image data. In this 
embodiment, the gradation range of the unnecessary image data 
is set as it is as a gradation range that satisfies the unwanted 
gradation condition in both of the modes . 

In the case where undertone remove mode is selected, the 
specific gradation XI is set as a unwanted gradation threshold 
value (also referred to as a removing gradation threshold value ) 
ot to set the unwanted gradation condition under which the target 
gradation lies in a gradation range having an upper limit equal 
to or lower than the threshold value. In the case where 
undertone/backside image remove mode is selected, the specific 
gradation X2 is set as the unwanted gradation threshold value 
<x to set the unwanted gradation condition under which the target 
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gradation lies in a gradation range having an upper limit equal 
to or lower than the threshold value . 

In FIGS. 10 and 11, for sake of easy explanation, the 
embodiment is described with reference to one histogram. On 
an actual basis, unwanted gradation threshold values etc, a 
m, ay are determined respectively with respect to three color 
components of C, M, Y of the input image data to set unwanted 
gradation conditions with respect to the respective color 
components . 

FIGS. 5A to 5C are examples of histograms in which the 
unwanted gradation threshold values OCc, otm, oty are determined 
respectively in the case where undertone/backside image remove 
mode is selected. 

(A- 2) unwanted pixel judging means 

The unwanted pixel judging means 332 judges whether a pixel 
is a unwanted pixel that is derived from the unnecessary image 
data and therefore to be removed based on the unwanted gradation 
condition determined by the unwanted gradation condition 
determining means 331d. The judgement is executed with respect 
to all the color components of C, M, Y composing the pixel by 
checking the input image data pixel by pixel. The input image 
data for judgement is not a processed data after smoothing by 
the smoothing processing means 331b but a raw input image data 
that has been inputted to the data removing unit 33. 
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The unwanted pixel judging means 332 judges that the pixel 
which satisfies all the mathematical expressions (2) to (4) as 
the unwanted pixel where gradations of the color components of 
C, M # Y are represented as Ic, Im, Iy, respectively. 

Ic< £Kc ... (2) 
Im< am ... (3) 
iy<ay ... (4) 

A pixel which has been judged as the unwanted pixel by 
the unwanted pixel judging means 332 with respect to the three 
color components is represented by a rectangular parallelepiped 
Wl in FIG. 13. FIG. 13 is a schematic diagram showing the 
respective gradations of the three color components of C, M, 
Y in terms of x- , y- , and z-axes in a three-dimensional space 
where the gradation of each of the color components ranges from 
0 to 255, i.e., 256 gradations. 

The image processing device in this embodiment judges the 
pixel which satisfies the unwanted gradation condition with 
respect to all the color components of C, M, Y as the unwanted 
pixel derived from the unnecessary image data . This arrangement 
prevents a possibility that a pixel which satisfies the unwanted 
gradation condition with respect to part of the color components 
is judged as the unwanted pixel and eliminates a likelihood that 
a reproduced color may be changed from the original color due 
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to removal of part of the color components . 

(A-3) unwanted pixel gradation conversion means 

The unwanted-pixel gradation conversion means 333 converts 
gradation data of the pixel which has been judged as the unwanted 
pixel by the unwanted pixel judging means 332 into the lowest 
gradation outputtable by the image processing device, namely, 
to gradation value 0 . The conversion is implemented with respect 
to each of the color components pixel by pixel . More specifically, 
the gradation conversion is represented by equations (5) to (7) 
where gradations of the unwanted pixel with respect to the color 
components of C, M, Y are Ic, Im, Iy, respectively. 



Ic = 


0 . . 


• (5) 


Im = 


0 . . 


• (6) 


Iy = 


0 . . 


• (7) 



In this way, setting each of the gradations of all the 
color components of the unwanted pixel as an outputtable lowest 
gradation, i.e., gradation value 0, enables to substantially 
remove the image data of the unwanted pixel. This arrangement 
facilitates image data compression. 

The gradation conversion with respect to the unwanted pixel 
corresponds to a spatial transformation in FIG. 13 where the 
pixel represented by the rectangular parallelepiped Wl is 
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transformed into the original point 0 with respect to the three 
axes representing gradations of the color components of C, M # 
Y, respectively. 

The unwanted pixel gradation conversion means 333 may 
convert the gradations of the unwanted pixels all at once after 
the unwanted pixel judging means 332 picks up all the unwanted 
pixels from the input image data. However, it may be preferable 
to implement the gradation conversion with respect to the 
unwanted pixel one by one each time the unwanted pixel judging 
means 332 picks up the unwanted pixel attributed to the 
unnecessary image data in order to enhance processing efficiency 
of the image processing device. 

In this embodiment, the gradation conversion has been 
described for the case where the gradation of the unwanted pixel 
is converted into gradation value of 0. Alternatively, 
gradation of the unwanted pixel with respect to each of the color 
components may be converted into a lowest gradation reproduceable 
by the image forming section 40 depending on the characteristic 
of the image forming section 40. As an altered form, each of 
the gradations of the unwanted pixel may be converted into a 
predetermined background gradation. In the latter altered 
arrangement, for example, image data which has been judged as 
undertone data of the original document can be converted into 
data of a background color different from the undertone of the 
original document to form an image with the converted background 
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color. 

FIGS. 6A to 6C are histograms of the respective color 
components of C, M, Y after the gradation conversion with respect 
to the unwanted pixel. As can be seen from these histograms, 
much of gradation components lower than the unwanted gradation 
threshold values ac, am, ay is removed after the gradation 
conversion although some of the gradation components lower than 
these unwanted gradation threshold values are left . The reason 
why some of the gradation components are left in the histograms 
is that some of the pixels have not been judged as the unwanted 
pixel and thus not been subjected to gradation conversion because 
these pixels satisfied the requirement of having a gradation 
lower than the corresponding unwanted gradation threshold value 
only with respect to one or two color components . 

Next, a gradation adjusting unit 34 for implementing a 
certain gradation adjustment to an adjusting image area is 
described. 

As mentioned above, as a result of removing the unwanted 
pixel having a lower gradation component in its most part with 
respect to all the three color components from the input image 
data, much of the lower gradation component of the input image 
data is erased, thereby generating a step portion (gradation 
difference) in the gradation distribution thereof. 
Particularly, if the image is of gradation data where the 
gradations are aligned in the order from lower to higher or vice 
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versa, the gradations of the adjacent pixels become discontinuous , 
thereby likely to generate a degraded reproduced image such as 
a pseudo outline or a partial non-image formed area. 

The above example is shown in FIGS. 14A to 14C. As can 
be seen from these figures, when pixels of lower gradation 
represented by the left -side columns in FIG. 14A are removed 
as the unwanted pixels, a gradation difference appears in a 
boundary region between the removed image data and the remaining 
part of the input image data, as shown in FIG. 14B. The gradation 
adjusting unit 34 eliminates or suppresses the gradation 
difference in the boundary region by setting an image area having 
a gradation closer to the gradation of the unwanted pixel as 
an adjusting image area to lower the gradation of an adjusting 
pixel extracted from the adjusting image area. 

Specific arrangements of the elements of the gradation 
adjusting unit 34 are described in the following section one 
by one. 

(B-l) adjusting gradation condition setter means 

The adjusting gradation condition setter means 341 sets 
an adjusting gradation condition for extracting an adjusting 
pixel, which is a target pixel to be processed in the gradation 
adjusting process. Specifically, adjusting gradation 

threshold values jSc, j3m, /?y are calculated by multiplying the 
unwanted gradation threshold values ac, am, ay by two in 
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accordance with equations (8) to (10) with respect to the color 
components of C, M, Y, respectively to set the adjusting gradation 
condition that an adjusting pixel should have gradations lower 
than the adjusting gradation threshold values )3c, j3m, /?y, 
respectively with respect to the color components of C, M, Y. 

j3 c = 2 • otc ... (8) 
/3m o 2 • am . . . (9) 
j3y = 2 • ay . . . (10) 

After removing the unnecessary image data, a gradation 
difference is generated in an area having a gradation closer 
to the unwanted gradation threshold values ac, am, ay, which 
results in a degraded reproduced image such as a pseudo outline 
and a non-image formed area. The fact that much of the gradation 
components lower than the unwanted gradation threshold values 
ac, am, ay are erased from the input image data means that 
the size of the gradation range to be removed from the input 
image data depends on the size of the unwanted gradation threshold 
value ac (am or ay), and that the size of the gradation range 
to be removed determines a gradation difference causing a 
degraded image reproduction. 

In view of the above, setting the adjusting gradation 
threshold values j3c, j3m, j3y based on the unwanted gradation 
threshold values ac, am, ay respectively and implementing a 
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gradation conversion to the adjusting pixel depending on the 
size of the adjusting gradation threshold value j3c, /Jm, )3y 
enables to suppress the gradation difference in conformance with 
the size of the gradation difference. 

Setting the adjusting gradation threshold values j3c, j3 
m, £y based on the unwanted gradation threshold values ac, ot 
m, ay enables to facilitate and expedite computation of the 
adjusting gradation threshold values j3c, j3m, £ y since the 
unwanted gradation threshold values ac, am, ay have been 
already determined. 

Further, since the adjusting gradation condition sets the 
requirement that the adjusting pixel should have a gradation 
not greater than the predetermined adjusting gradation threshold 
value, adjusting pixel extracting process, which is described 
below, can be facilitated and expedited in accordance with a 
simplified computation. 

(B-2) adjusting pixel judging means 

The adjusting pixel judging means 342 judges whether a 
pixel of the input image data after the unnecessary image data 
removal by the data removing unit 33 is an adjusting pixel which 
satisfies the aforementioned adjusting gradation condition with 
respect to all the gradations of the color components of C, M, 
Y. 

Specifically, the adjusting gradation judging means 342 



34 




P700US 



checks the remaining pixels one by one and judges that the checked 
pixel is the adjusting pixel in the case where the checked pixel 
satisfies all the following mathematical expressions (11) to 
(13) where Ic, Im, Iy respectively represent gradations of the 
color components of C, M, Y of the checked pixel. 

Ic < j3c . . . (11) 
Im < jBm . . . (12) 
iy < J8y . . . (13) 

The pixel which has been judged as the adjusting pixel 
by the adjusting gradation judging means 342 possesses a spatial 
area corresponding to a rectangular parallelepiped W2 devoid 
of the rectangular parallelepiped Wl representing the unwanted 
pixel in the three-dimensional space of FIG. 13. 

In this way, in the image processing device of this 
embodiment, the pixel which satisfies the adjusting gradation 
condition with respect to all the color components of C, M, Y 
is judged as the adjusting pixel attributed to the adjusting 
image area, and gradation conversion is implemented with respect 
to the adjusting pixel which is part of the input image data. 
In this arrangement, there can be prevented an overall color 
change of a reproduced image due to change of the gradations 
over the entirety of the input image data. Further, setting 
an appropriate adjusting gradation condition enables to pick 
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up a minimal number of pixels necessary for gradation adjustment 
of the adjusting pixel. Thereby, gradation difference can be 
eliminated or suppressed while suppressing color change of the 
reproduced image as much as possible , thus preventing a degraded 
image reproduction . 

(B-3) adjusting pixel gradation conversion means 

The adjusting pixel gradation conversion means 343 
implements a certain gradation conversion with respect to the 
adjusting pixel to eliminate or suppress a gradation difference . 
As shown in FIG. 3, the adjusting pixel gradation conversion 
means 343 is divided into the following three elements: 

(B-3-1) target color component setter means 343a 

(B-3 -2) common gradation lowering rate setter means 343b 

(B-3-3) gradation conversion implementing means 343c 

(B-3-1) target color component setter means 

The target color component setter means 343a sets a 
specific color among the color components of C, M, Y as a target 
color component N with respect to all the adjusting pixels one 
by one. The target color component N is a color component in 
the adjusting pixel having a largest possibility of generating 
the gradation difference. 

Specifically, the target color component N is a color 
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component having a gradation with a smallest distance relative 
to the adjusting gradation threshold value with respect to each 
of the adjusting pixels . The relative distance to the adjusting 
gradation threshold value in this embodiment is a ratio of a 
difference between the gradation of the adjusting pixel and the 
adjusting gradation threshold value to the adjusting gradation 
threshold value . Relative distances Lc, Lm, Ly can be calculated 
in accordance with the following equations (14) to (16) where 
Ic, lm, Iy are gradations of the color components of C, M, Y 
of the adjusting pixel, and j3c, j8m, )3y are adjusting gradation 
threshold values of the respective color components: 



Lc = ( £c 
Lm = ( jSm 
Ly = ()8y 



- Ic)/j3c 

- Im) / j3m 

- Iy)/£y 



... (14) 
... (15) 
. . . (16) 



The target color component N is a color component having 
the greatest value among Lc, Lm, Ly. 

The reason for setting the color component having a 
gradation closest to the adjusting gradation threshold value 
as the target color component N is as follows . 

Generally, most of the gradation difference generated in 
an area having a gradation closer to the unwanted gradation 
threshold value occ ( am or ay) exhibits a characteristic that 
one specific color component has a gradation closer to the 
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corresponding unwanted gradation threshold value and the other 
color components have a gradation sufficiently smaller than the 
corresponding unwanted gradation threshold value. When the 
gradation of the specific one of the color components is lower 
than the corresponding unwanted gradation threshold value, the 
gradation is converted into a background gradation (gradation 
value of 0) . On the other hand, when the gradation of the specif ic 
one of the color components is greater than the corresponding 
unwanted gradation threshold value, the gradation is maintained 
as it is . In other words , it can be said that the color component 
having the gradation closer to the corresponding unwanted 
gradation threshold value causes the gradation difference. 

More specifically, let's say that a pixel of a certain 
pixel group is such that the gradation Ic of the color component 
C and the gradation Im of the color component M are presumed 
to be gradations sufficiently smaller than the corresponding 
unwanted gradation threshold values occ and am, respectively. 
In such a case, a judgement as to whether the pixel of the pixel 
group is the unwanted pixel depends on a judgement as to whether 
the gradation Iy of the color component Y of the pixel is greater 
or smaller than the unwanted gradation threshold value ot y . When 
the gradation Iy of the color component Y is lower than the unwanted 
gradation threshold value ay, the pixel is judged as the unwanted 
pixel with the result that all the gradations Ic, Im, Iy are 
converted into gradation value of 0. At this time, since a 
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gradation change rate (lowering rate) of the gradation Iy is 
largest, a largest gradation difference is generated in a 
boundary region between the unwanted pixel and proximate pixels 
with respect to the color component of Y. 

To sum up, the gradation of the color component primarily 
responsible for generation of the gradation difference has a 
largest relative distance to the corresponding adjusting 
gradation threshold value as compared with the other color 
components. Therefore, it can be said that the thus obtained 
target color component N causes a gradation difference. 

FIG. 15 shows a gradation conversion curve used for 
converting the remaining one of the color components of the pixel 
where the other two of the color components are judged to have 
a gradation lower than the corresponding unwanted gradation 
threshold value. Note that the remaining one of the color 
components is generally the target color component. In FIG. 
15, horizontal axis represents gradation before conversion and 
vertical axis represents gradation after conversion. 

For instance, let it be assumed that the gradation of a 
certain color component N of a certain pixel is In. According 
to the gradation conversion curve, the gradation In cannot be 
converted if In^an where a n is the unwanted gradation threshold 
value. Therefore, the gradation after conversion is set as the 
gradation In. On the other hand, if In < an, the pixel having 
the gradation In is the unwanted pixel. Accordingly, the 
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gradation In is converted into gradation value of 0. Thus, as 
shown in FIG. 15, a gradation difference in accordance with the 
size of an is generated in the vicinity of the unwanted gradation 
threshold value an. 

(B-3-2) common gradation lowering rate setter means 

The common gradation lowering rate setter means 343b 
calculates a gradation conversion function capable of 
efficiently suppressing the gradation difference with respect 
to the target color component N to set a gradation lowering rate 
r of the target color component N which has been calculated based 
on the gradation conversion function, as a common gradation 
lowering rate R. 

The gradation In (where n is either one of c, m, y) before 
conversion of the target color component N (where N is either 
one of C, M, Y) lies within a gradation range not smaller than 
the unwanted gradation threshold value an and smaller than the 
adjusting gradation threshold value /3n. The target color 
component N is generally a color component primarily responsible 
for generation of the gradation difference due to removal of 
the gradation equal to or lower than the unwanted gradation 
threshold value a n thereof. Therefore, converting the 
gradation value In of the target color component N of the adjusting 
pixel which lies in the range not smaller than an and smaller 
than j8 n into a gradation ranging from 0 to smaller than j3 n enables 
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to supplement the gradation equal to or smaller than the unwanted 
gradation threshold value a n , thereby suppressing the gradation 
difference . 

More specifically, referring to FIGS. 15 and 16, in the 
state where the unnecessary image data has been removed, the 
gradation range having a gradation lower than the unwanted 
gradation threshold value a n and including the value an is erased, 
thereby generating a gradation difference in the proximity of 
the unwanted gradation threshold value an (see FIG. 15). 
Assuming that the target color component N is of an adjusting 
pixel, the gradation In of the target color component N of the 
adjusting pixel lies between the unwanted gradation threshold 
value oc n and the adjusting gradation threshold value )3n. 
Implementing a gradation conversion in such a manner as to extend 
the gradation range of the target color component N of the 
adjusting pixel ranging from an to j8n to a gradation ranging 
from 0 to |8n enables to make the gradation distribution after 
the conversion continuous in a manner ranging from 0 to 255, 
thus reducing the gradation difference. 

FIG. 16 shows an example of gradation conversion. The 
gradation conversion in FIG. 16 is such that gradation is 
converted in accordance with a gradation conversion curve (in 
this case, shown by a straight line) which interpolates the 
gradation In of the target color component N of the adjusting 
pixel between (an, 0) and (j3n, j8n). 
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FIG- 16 shows an example of the above gradation conversion. 
In FIG. 16, the gradation conversion in accordance with the linear 
gradation conversion curve is represented by a function shown 
by equation (17) where In represents gradation of the target 
color component N before conversion and In ' represents gradation 
after conversion . 



The gradation lowering rate r of the target color component 
N is calculated in accordance with equation (18). 

r = In'/In 

= 13 /( 13 - a ) - jS/in . . . (18) 

Converting the gradation of the adjusting pixel based on 
the thus calculated gradation lowering rate r suppresses the 
gradation difference of the target color component N. In this 
embodiment, the gradation lowering rate r of the target color 
component N is set as the common gradation lowering rate R 
represented by the following equation (19). 

R = r . . . (19) 

The common gradation lowering rate R is a gradation 



In' = (£/(£ -<*))• in -J3 



(17) 
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lowering rate used for converting the gradation with respect 
to all the three components of the adjusting pixel. 

(B-3-3) gradation conversion Implementing means 

The gradation conversion implementing means 343c 
implements gradation conversion with respect to gradations Ic, 
Im, Iy of the color components of C, M, Y of the adjusting pixel 
based on the common gradation lowering rate R which has been 
set by the common gradation lowering rate setter means 343b. 

Specifically, the gradation conversion by the gradation 
conversion implementing means 343c is represented by equations 
(20) to (22) where Im, Ic, Iy represent gradations of the color 
components of C, M, Y of the adjusting pixel before conversion, 
and Ic', Im' , Iy' represent respective gradations after 
conversion. 

Ic' = R • Ic . . . (20) 
Im' = R ■ Im ... (21) 
Iy' = R ■ Iy ... (22) 

In the case where image data is processed in terms of digital 
value, the gradations of the respective color components are 
represented by an integer. In this case, Ic', Im' , Iy' after 
the conversion may be set to an appropriate integer by rounding 
off the respective values. 
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Thus, gradation of each of the adjusting pixels is 
converted at a substantially same gradation lowering rate ( common 
gradation lowering rate R) with respect to all the color 
components of C, M, Y. This arrangement suppresses change in 
hue of a reproduced image although the brightness of the 
reproduced image may be changed. 

To sum up the above, according to the gradation conversion 
of the adjusting pixel by the gradation conversion implementing 
means 343c, gradation conversion is implemented only with respect 
to part of the pixels constituting the input image data. 
Furthermore, gradations of the adjusting pixel are converted 
at the substantially same rate with respect to all the three 
color components . This arrangement makes it possible to 
suppress the gradation difference while suppressing change of 
a color of a reproduced image as much as possible so as to prevent 
a degraded color image reproduction. 

FIGS. 7A to 7C are histograms showing gradation 
distribution of the adjusting image area after the gradation 
conversion with respect to the histograms of FIGS . 6A to 6C showing 
the gradation distribution before removal of unnecessary image 
data. As shown in these histograms, implementing the gradation 
conversion with respect to the adjusting image area supplements 
lower gradation components which have been removed by removal 
of the unnecessary image data. 

As mentioned above, according to an aspect of the inventive 
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image processing device, a pixel which satisfies the unwanted 
gradation condition with respect to all the color components 
of C, M, Y is judged as the unwanted pixel attributed to the 
unnecessary image data to be removed. In other words , the pixel 
which satisfies the unwanted gradation condition with respect 
to part of the color components is not judged as the unwanted 
pixel. This arrangement prevents color change in a reproduced 
image due to removal of the gradation of part of the color 
components. Thus, unnecessary image data can be securely 
removed while suppressing degraded image reproduction of the 
input image data. 

According to another aspect of this invention , the unwanted 
gradation condition is set color component by component by 
referring to gradation data of the input image . This arrangement 
enables to set an adequate condition depending on the 
characteristic of the input image data and accurately extract 
unnecessary image data included in the input image data to remove 
the unnecessary image data. 

According to yet another aspect of this invention, a user 
can select which part of the input image data should be removed 
as the unnecessary image data among a variety of kinds of data 
such as undertone data and backside image data to set the unwanted 
gradation condition based on the gradation range of the selected 
unnecessary image data. This arrangement is user-friendly 
because the image processing device can cope with versatile 
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demands of image processing such as what kind of image data to 
be removed or to what extent the image data to be removed. 

The image processing device of the invention can handle 
the following situation. Removing the unnecessary image data 
may likely to generate a gradation difference. According to 
still another aspect of this invention, however, a pixel which 
satisfies the adjusting gradation condition with respect to all 
the color components of C, M, Y is judged as the adjusting pixel 
to implement gradation conversion of the adjusting pixel. This 
arrangement enables to suppress the gradation difference without 
undesirably changing the colors of all the pixels of the input 
image data, thereby preventing degraded image reproduction. 

According to a further aspect of this invention, the 
adjusting gradation condition for extracting the adjusting image 
area is set color component by component depending on the unwanted 
gradation condition. This arrangement enables to set the 
gradation range of the adjusting image area in conformance with 
the size of the gradation difference to suppress the gradation 
difference while minimizing the size of the adjusting image area 
having a possibility of color change. 

According to yet another aspect of this invention, the 
gradation conversion with respect to each of the adjusting pixels 
of the adjusting image area is conducted by extracting a color 
component primarily responsible for generation of the gradation 
difference as a target color component with respect to all the 
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adjusting pixels one by one . This arrangement enables to 
adequately suppress the gradation difference with respect to 
the target color component, thereby appropriately suppressing 
the gradation difference. 

According to a still further aspect of this invention, 
gradation conversion with respect to each of the adjusting pixels 
of the adjusting image area is implemented based on the 
substantially same gradation lowering rate common in all the 
color components, namely, based on an appropriate gradation 
lowering rate for the target color component with respect to 
fU all the adjusting pixels one by one. This arrangement enables 
ru to minimize change in hue of a reproduced image without varying 
^ balance of the color components of each of the adjusting pixels. 

jUs, 

i_ One embodiment of the present invention has been described 

g in the above section. An image processing device according to 
this invention is not limited to the above, and may take the 
following modification and alterations. 

(1) The image processing device of this invention in the 
embodiment is incorporated in a color copier. Alternatively, 
the image processing device may be incorporated in a color 
facsimile machine . In the altered arrangement , image data that 
has been read by a scanner of the facsimile machine is treated 
as input image data for image processing in data transmission, 
whereas image data that has been received by the facsimile machine 
is treated as input image data for image processing in data 
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reception. As an altered form, image processing may be 
implemented with respect to input image data that has been read 
by a scanner of an external device. As a further altered form, 
image data may be outputted to a printer as an external device 
for image processing. 

(2) In the embodiment, the image processing device 
implements image processing with respect to input image data 
composed of three color components of C, M, Y. The input image 
data may be composed of three primary colors of R, G, B. 

(3) In the embodiment, the unwanted gradation condition 
is set based on a histogram, i.e., gradation distribution of 
the input image data. As far as the gradation range of the 
unnecessary image data can be specified, any setter means may 
be applicable. Particularly, in the case where color paper of 
a specific color is used, the gradation range of the unnecessary 
image data is generally known. In such a case, the unwanted 
gradation condition can be determined based on the known 
gradation range . 

(4) In the embodiment, the unwanted gradation condition 
is set based on the gradation data of all the pixels of the input 
image data. Alternatively, the unwanted gradation condition 
may be determined based on gradation data of part of the pixels 
of the input image data. In the altered arrangement, part of 
the pixels may be some of the pixels that have been arbitrarily 
picked up from the input image data or may be a pixel having 
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a lower probability of being derived from necessary image data 
such as corner pixels of the input image data. 

(5) In the embodiment, a specific gradation has been 
searched for after implementing a smoothing process with respect 
to the curve of the histogram that has been produced from the 
input image data. Alternatively, the smoothing process may be 
omitted. 

(6) In the embodiment, a gradation that satisfies any 
one of the conditions (I) to (IV) is set as a specific gradation, 
and the unwanted gradation condition is set based on the specific 
gradation. Alternatively, as far as the gradation range of the 
unnecessary image data is detectable, the specific gradation 
may be set based on a judgement as to whether the checked gradation 
satisfies the conditions ( I ) and ( II ) , or ( I ) , ( II ) , and ( III ) , 
or (I), (II), and (IV), or any one of (I) to (IV) and other 
f actor ( s ) . 

(7) In the embodiment, a specific gradation is detected 
based on the histogram, the gradation range of the unnecessary 
image data is determined based on the specific gradation, and 
the gradation condition for extracting the gradation range of 
the unnecessary image data is set as the unwanted gradation 
condition. Alternatively, as far as the condition for removing 
the unnecessary image data is securely obtainable, a condition 
for extracting a gradation range slightly wider than the 
gradation range of the unnecessary image data may be set as the 
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unwanted gradation condition. As an altered form, in the case 
where a necessary image area is required to be maintained even 
if part of the unnecessary image data is left, a condition for 
extracting a gradation range slightly narrower than the gradation 
range of the unnecessary image data may be set as the unwanted 
gradation condition . 

(8) In the embodiment, when setting the unwanted 
gradation condition, undertone remove mode and 
undertone/backside image remove mode are selectively settable 
by a user. Alternatively, an arrangement may be applicable such 
that the image processing device itself automatically judges 
as to what kind of unnecessary image data such as undertone data 
and backside image data exists depending on the kind of input 
image data and selects the mode based on a judgement result. 
For instance, the judgement may be made based on the size of 
the first and second specific gradation values XI, X2 of the 
color components of C, M, Y or the ratio of the first value X2 
to the second value X2 . 

( 9 ) In the embodiment , the unwanted pixel is removed by 
converting the gradation of the unwanted pixel to gradation value 
of 0, namely, by substantially eliminating the gradation data 
of the unwanted pixel . As an altered arrangement , the gradation 
of the unwanted pixel may be converted into a gradation of a 
background color . In the altered arrangement , output image data 
having an arbitrary undertone can be obtained. 
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( 10 ) In the embodiment , undertone remove mode of removing 
only undertone data from the unnecessary image data and 
undertone/backside image remove mode of removing both of 
undertone data and backside image data are selectable. 
Alternatively, backside image remove mode of removing only 
backside image data may be additionally settable. 

A case where backside image remove mode is set is described 
with reference to the histogram of FIG. 17 which is a histogram 
of one of the color components of C, M, Y, the gradation range 
or width LI of the first peak appearing on lower gradation side 
represents gradation distribution of the undertone data, and 
the gradation range or width L2 of the second peak that follows 
the first peak represents gradation range of the backside image 
data. In the backside image remove mode, setting the condition 
for extracting the gradation width L2 of the second peak as the 
unwanted gradation condition enables to remove the unwanted pixel 
attributed to the backside image data from the input image data. 
In this case, the unwanted gradation condition includes the 
gradation not smaller than the gradation XI and not greater than 
the gradation X2 with respect to each of the color components. 

In the above case , it is preferable to convert the gradation 
of the unwanted pixel corresponding to the backside image data 
into a gradation of undertone data. The gradation of undertone 
data can be set by any setter means, for example, based on the 
gradation width LI of the first peak corresponding to the 
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undertone data. Particularly, it may be preferable to set the 
gradation value XP of the peak point of the first peak as a 
representative gradation of the undertone data to convert the 
gradation of unnecessary image data ( in this case , backside image 
data) into the gradation XP with respect to all the color 
components one by one. 

( 11 ) In the embodiment , unnecessary image data is removed 
based on the assumption that the unnecessary image data consists 
of one kind of undertone data and one kind of backside image 
data. Even if input image data includes three or more different 
kinds of unnecessary image data such that undertone data of plural 
colors and backside image data of plural colors coexist, all 
these kinds of unnecessary image data can be removed by 
implementing the following process. Three or more specific 
gradations are detected from each of the histograms , and the 
unwanted gradation condition is determined by setting the highest 
specific gradation among the detected gradations as the unwanted 
gradation threshold value depending on the number of kinds of 
unnecessary image data. 

(12) In the embodiment, gradation adjustment of the 
adjusting image area is implemented together with unnecessary 
data removal. Alternatively, the gradation adjustment of the 
adjusting image area may be omitted. Particularly, in the case 
where no gradation difference is generated, or the gradation 
difference is negligibly small, or no gradation change of the 
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image data other than the unnecessary image data is required, 
gradation adjustment of the adjusting image area is not 
necessary. 

(13) In the embodiment, adjusting gradation threshold 
values j3c, j3m, £y are respectively set based on the unwanted 
gradation threshold values ac, am, ay. As an altered form, 
each of the adjusting gradation threshold values £c, j8m, )8 
y may be set at a certain value without considering the unwanted 
gradation threshold values a c, am, ay. For instance, 
adjusting gradation threshold values may be set in advance with 
respect to the color components of C, M, Y, respectively. 

( 14 ) In the embodiment , the adjusting gradation threshold 
values i8c, j3m, 3 y are set by multiplying the unwanted gradation 
threshold values a c, am, a y by two. An appropriate 
magnification ratio may be set by considering to what extent 
the gradation difference is required to be suppressed or to what 
extent the number of adjusting pixels having a possibility of 
color change due to gradation difference suppression may be 
allowed to decrease . Alternatively , a gradation value away from 
the unwanted gradation threshold value ac (am, or ay) by a 
certain gradation width may be set as the adjusting gradation 
threshold value )8 c ( /3m, £y). 

( 15 ) In the embodiment , gradation conversion of extending 
the gradation range of an to ]8n to the gradation range of 0 
to j8 n in accordance with the linear gradation conversion curve 
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as shown in FIG. 16 is implemented. Alternatively, an arbitrary 
quadratic (or non- linear) gradation conversion curve such as 
the one represented by a quadratic function may be adopted. In 
the altered arrangement, since the gradation range having a 
gradation equal to or greater than the adjusting gradation 
threshold value is not subjected to gradation conversion, it 
may be preferable to implement the following process. The 
gradation change amount in proximity of the adjusting gradation 
y3 threshold value may be minimized to continuously connect the 
01 gradation area which is not subjected to gradation conversion 

a R 
t? i 

fy (gradation area including the gradation equal to or greater than 

fU the adjusting gradation threshold value) and the gradation area 

Q which is subjected to gradation conversion (gradation area 

M including the gradation not larger than the adjusting gradation 



fj 



threshold value) . 

More specifically, a quadratic function shown by equation 
(23) may be applicable where In represents gradation before 
conversion and In' represents gradation after conversion. 

In' = -In 2 / an + 5 • In - 4- an ... (23) 

The gradation conversion curve in accordance with equation 
(23) is shown in FIG. 18. According to the gradation conversion 
curve , the gradation curve in proximity of the unwanted gradation 
threshold value a n can be continuously connected while 
extensively converting the gradation range of an to j3 n to the 
gradation range of 0 to i8n and maintaining the slope of the 
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point ()3n, )3n) at 1. 

According to the above gradation conversion curve, since 
the function is quadratic, gradation conversion can be 
implemented by a simplified computation. 

( 16 ) In the embodiment , gradation conversion of extending 
the gradation range of an to j3n to the gradation range of 0 
to j3 n in accordance with the linear gradation conversion curve 
as shown inFIG. 16 is implemented. Alternatively, the lowermost 
gradation of the gradation range after the conversion may be 
set to a lowest gradation (reproduceable limit gradation) IL 
which is outputtable by the image forming section 40. As far 
as a linear gradation curve is used, the gradation range of 0t 
n to 13 n before conversion can be converted into the gradation 
range of IL to /Jn, as shown in FIG. 19. 

(17) In the embodiment, when implementing gradation 
conversion with respect to the adjusting image area, a target 
color component is determined each time the adjusting pixel is 
picked up, and gradation conversion with respect to all the color 
components is implemented based on an appropriate gradation 
lowering rate for the target color component. Alternatively, 
a common gradation lowering rate may be set without considering 
the target color component, and gradation conversion may be 
implemented based on the common gradation lowering rate. 

(18) In the embodiment, as shown in FIG. 3, gradation 
of the adjusting image area is adjusted after the unnecessary 
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Image data removal- As far as the processing order is settled 
in a state that each processing is enabled, the processing order 
is not limited to what is disclosed in the embodiment . For 
instance, after setting the unwanted gradation condition and 
the adjusting gradation condition, the pixels constituting the 
input image data may be checked one by one. When the gradation 
of the checked pixel satisfies the unwanted gradation condition, 
the checked pixel may be set as the unwanted pixel and gradation 
conversion may be implemented to remove the unwanted pixel . When 
the gradation of the checked pixel satisfies the adjusting 
gradation condition , the checked pixel may be set as the adjusting 
pixel, and gradation conversion is implemented to adjust the 
gradation of the adjusting pixel. 

This application is based on patent application No. 
11-265219 filed in Japan, the contents of which are hereby 
incorporated by references . 

As this invention may be embodied in several forms without 
departing from the spirit of essential characteristics thereof, 
the present embodiment is therefore illustrative an not 
restrictive, since the scope of the invention is defined by the 
appended claims rather than by the description preceding them, 
and all changes that fall within metes and bounds of the claims, 
or equivalence of such metes and bounds are therefore intended 
to embraced by the claims . 
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